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PROBLEM TO BE SOLVED: To improve a 
detection function for a target image such as a 
face in a speed and accuracy by performing 
screening by a candidate selecting part, selecting 
and eliminating many input images that do not 
include a face in the area and subsequently 
processing only a candidate area by a face 
detecting part. SOLUTION: A candidate selecting 
part 12 includes a linear correlating part 52 and a 
processing module 54 and they forms a linear 
matched filter 56. The part 12 also includes 
contrast calculating parts 58, 60 and 62 and a 
decision module 64 and they forms a nonlinear 
filter 66. The filter 56 selects many interim 
candidate areas that seem to include a face an 
input image according to certain reference. The 
nonlinear filter examines the selected interim 
candidate areas and abandons undesirable 
candidate areas according to another reference. 
A face detecting part 14 processes residual areas 
as a candidate area. The associated operation of 
the filters 56 and 66 increases the selection 
accuracy of an optimum candidate area by the 
part 12. 
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[00 37] Rowley(5^t i 4ffi«JtB*^tt. 9uf\ A eKiCtflWrRfta-HTftSnTtJ 0 . "original 
}jIHfe<7)30 x 30B«^Wi (Ifyn-y^) fc*t1*£ _face_detection_routine()" "a PP ly_NN' s(l,i, 

• *-y hy-^(NN)^#xir-;Wcfcv^ j)" t lXWSMZti&. 

xm?&. a«««»^&n. it mom [0038] 

orlglnal_face_detectlon_routine() { 

calculate a pyramid of downscaled versions 



) 



for (( = 0;» < nurnber_ofJe\rals_in_pyramid;«++) ( 

Define "downscale_image" as the level l of the pyramid; 
for (I = 0;l < helghf_of_dowriscalejmaas;l*=10) { 
for (j = 0;] < width_of-downscalejmage;j+=10) { 
apply_NNs(MJ); 

> 

) 



appry_NN's((,lj) { 

Pre-process the block centered at position (i,j) 

(remove DC and illumination components, and normalize) ; 
Apply the Candidate NN at position (i,|) : 
if (selected) { 

Apply the Location NN to obtain the 

fine-tuned candidate position (x,y) ; 
Apply the Verification NN's at position (x,y) ; 
if (selected) { 

Declare (x,y) as the center of a face at scale (; 

) 



[00 39] mffi^XrAlOOl^ffi^fi, Rowley ace_detection_routine() " tWS? tlh . 

\iifckhw&m&wm\z$Lr> tw. ar^ i o o a o 3 

t£ 0 tC IzWzmPA?* WmiZtl. "combined_f [«2 ] 
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combined Jacejtetectlon_routine() { 

Calculate a pyramid of downscale versions 

of the original image {downscale rate = 1.2). 
/• For all the levels of the pyramid, except for the last Al ones, 

use the candidate selection scheme of the candidate selector 12 as a pre-filter for 
theNN's. */ 

for (t = 0\( < number_ofJevals_in_pyramld - Al;f++) { 

Calculate the DCT-domain convolution of the level 1 + Af of the pyramid. 
Define "downscalejmage" as the level t of the pyramid, 
for (I - 0;l < height_of_downscalejmage;l++) { 
far (j = OJ < wIdth_of_downscale_ima9e;i-H-) { 

If ((i,j) is selected by the matched filtering decision rule) 
if ((i,j) is selected by the non-linear fUtarJC 

appry_NN's (!,l.j); /* see pseudo-code for Rowley et al. scheme */ 

} 

} 

} 

r For the last M levels of the pyramid, use the original scheme. V 

far (! = number_oMevels_in_pyramid - Ai;t < number_ofJevelsJn_pyramid;f++) { 

Define "downscalajmage" as the level ( of the pyramid. 

for (i = 0;i<height_of_downscalejmage;i+=10) ( 

for (i = OJ < width_of_downscale_image;)+=10) { 

apply_NN's(J,l,i); • see pseudo-code for Rowley et al. scheme V 

} 

) 

} 

[004 1] lyXn-MWMmd^Mi, WTM^b 
MZ~o\^XWi^htlh. Rowley(3*HcJ:^^i:^Xf- 

j*\<Mtt<nmnw&tm>m3- t* iz&^xwmx 

&x>r~)V- \sK.Mzft\,X\Wft^X^hZ\ktoW$k 
IzHttlt. Sfefc, isXrM0X°liZ*-V>?'2tl 

tzx^m^^nm^znLxnwv-rtim^fihcr> 
itzMLx, RwieymHzXh^z^vam^ii—r 

kffi$7*n vfco^'kcomMlizniXiOfrmiZtih, 

xmffZti&ncivxJ >M£y 4 )V?WiW$. ft J: 
4 )V^%<nr(k^y^~^xmi^h 
mix n y h 5x vxmz^x itzmmco^-^-y^ 

[0042] mhttmmmmxiz, dct f^m 

#20T * 0 » *VM ^~ 'J > ^ibW • 2 ( flrlo T > 8x1 . 2 

m&y 4 )V9%cnwmi>2-'-)vwx-mfotihmm\i 

ii3,000, -eLT, tfflM7 4 lV9te<ti9&. : £i'3.--A> 

xmhtimm^x-ht. 

[0043] 06t, 7 < MWMV&Mti&ifi 



mn^2xxu • mr, m^mmizmbtn ? << 
wman-ti, 7 4)v?mt. 7<>v?we.®m^ 
K^nm^<^yv~^yvm ( vu--y?) m 

M-ftztthm. mimmmzmbtihmz, mm 

\t. m\am* [*yyjy) x%<. \>v-->r 
(*7^y) «To«ftLv^ iwttiiHiifi 

fcv^Oti, H^ttl^XrAlO^A^Wf^LT, * 

tt*{±7 /w*8t4jjaw6fc x -o x . fcfc* 1 mmm-s 

[ 0 0 4 4 ] 7 4 /l^&£j£SI516Ji, ^fca^-y h7 

4. m.WL^-4 y^cmmmi^ ^xA-imi/mmm 

31M y38*(IDCr)»80£-&/,'T > ^&. T^fta-'y 
frt,mY*4ys$mtt>. vx^-78(i, H7t^ 
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ti&mmssMHi* m^za^x-mxmbfifzfu «, 

?-C5j*3*VO*4. ?"o^(0,0)t(0,l)ll e 
«fc$#3fi£#£Si*>bT^S. 7'n-y?(4,7). (5, 
6). (5,7), (6,5). (6,6). (6,7), (7,4). (7,5). (7, 

6) mi (7 , 7) x-ftffi t>ti& Tii<r>^sm(m»\tJ 4 x 
[0045] ^mtm^^x^tf^rr-th t . iDcrgp 

■tS. ^«$S:S#6itl>B«#7^?«T'£>l>o Hfe 
flfc 7 ^ ^ ? * * u 18 *l . «jHiO12*04f> 

j^ffiRiiaK* 1 1 comm^fo s * ■?* c: tie** *i4 . 7 

[0046] 1 UT . 7 < JV9m.m 

lmvwzommstii, nef* y-u~-ymmm 

«4«F^ yjd^DCTF^-f y£33»S*u vx? 
Sit, B^ffiHIM-fy^vRStL. -fLt^/l^SS: 

KoaitfcfetT^ftsita. fMt#fSi&-m. dct 

SP76J4 b U--y/fflWRtWt44»t*i. DCTSI57 

*>^dct 4 >"\£3*-<r<& . ^ms^iaBfmvx 

*-78N3ifetl*. VX#-78ii. 07fc^-fVX^82 

#£B*su «sitt««afttiDCTaP8<yNai4. iocrgg 
sotivx^asft^iiBiMjT^sPBi f.>m y^M-f 

^J&£?t3 . ^-ffcL-y F74teIDCT^80fc-P&#*oT 

a o , ^x^asn/cfiBff^PBi y-eiswR 

[0047] wwmm&xn, 7 * wtimmwi 
timiiii'ATMQiizii&tv&w zcommviz, mm 

7 a )v?mm%&xh . * lt . mrsfut 7 4 ^ 

[0048] fflkV&tUhk. A^B«W+ TfflSrjg «W 

Wffith. Xr-yriOOT'ti, ^7 7^W4>^ * 
< F l/--y^"fflHBm* s 7 ^ ;W?;R4f£SBl6KA:a 
3*U>. Kfc, Xr-y7°102T'{i. BWfcW^b^ 
■y FtJ^TP^fbStU T^MSU^ISiliSflS. 

WtB#(i^»^r-y7i04T-, ocranet J: -?TMb1 
RX-f y*^DCTh'^-f i"\Se»3*l*. XT -y 7106? 

urn'mmt^x^-mz^x^x^^fm^ 



fetl£B»"7 a )VmXb&. XT-yrilOT- 

a. 7^^^^(i^ ; &ui8tia«§^, mummm 

fcA-^T. »ffi^XTA10coMMKg|512*^«®^ 

[0049] rnmtx\t. h u-->rmmmv 
x9^htimmtxw-mmmf^ti^\ t\<nm 
tmxu. f ]s--yymmmtm£nciffl6££ 

iDtrat i o?sra f * 4" yNas^sns . f*. 
7^^^s^ai#ffi-r 0 «ats 7^ 

'Jl8tlE«3<t6. ioftf«(i»fi^ 

a^v^'. mmy a )vm\±mmmmx%t>iit 
7A>umtmtxh&. 

[0050] »M^il^^)<7)A*B««Tii]M^ 

m o*yyA ymmzMiz^xmm&. m%za 
^t. xt >y 7112?. xmmmmmyxT^wiz 
mm*>ti&. at, -yriu?, A^BmfiiM 

fflWJSDa h" ^ y iz& v K^>it h <r>im& I \* . x 
T-y 7116T14. A*B««* , C*«ffiBBMIW( i aBli* 
^Sr^B»S^* i WK^r7 ^ WX&Wmti?*'- 
^UzX-yXMiR^til, Xf >y7°118?ii, mRZti 

stt . mm $ htzmmmvmmmmmtfM&m 
mm^mix^i*^ 0 j^w^srgfts . -omus 

[00 5 1 ] Xf 77120X14. BflMHttaa«affi# 

7 ^ ;k^66^«t l,iilfK$n/i#B«^<7)^>-xr- 

rt<0±^KIRSStLTV^ii:*»S*LV^ X 
f-'yri22T"(4, #^ff?7 A)V9bb<nm^i>a.~)V(A 
(,z£ ^xmmWmm.co&? yYyx YWfiiDLh nyv 
yx hrmtkmZtiZ . 3y h 7X hHifiSiSt S 3 
yh^XF ffl^^ofcBftfl^^Mifflffl^T'* h b 

£flb&*afcfco*S!£ , »tBf!14>Dri:"5i?S«i;"« t J: 

6«»ai»« 9 4 7"fc J: o T JiXf - -y 71 14M22*«A^ 

o{4. Mfflffl«^a^ t-r^f xcoii^^fv^nrtgtt 
tfhhfri>xhz>. 

[0052] wffasrsmwrtt. x^yrin. nea 

yil8{±T«M^5&axg*^ 6*6*. 6 . ; O^SfeWT" 

si. fflPBm*^HfffiA&^fflmfM^(t*^§n 
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¥f^mimm\ mmm^mm<. mmmmxh&t 
[00 53] mwm 

WMZtit. 7^?«rffro#xf--y7°ti3Vvc, zti 
hM®7v 7 ? 4o<7)7'p -y tifit 0 £>ff 

6*1, Xi,i=l,..,4T"^^tLl.„ lo<75(N+l)x(N+l)(0 

r(n.m) = E E y(p,q)-x( P + n,q + m). 0<n.i 

[00 55] m,<rm±Ti B^ff »H i: SHUTC* & : I » 5 3 

r-Y 1 X 1 +Y 2 X 2+ Y 3 X 3 +Y 4 X 4 , 



7"p 7 9 r *mE<3 ± 3 . 7*P 

-y? rWS_UB*»fcNfr, NJIJ-CfflfigSnSN x N«7'P 

ZBi&t&. I^nv^tMO^^N x NC97" 

n ±iai. ft* (7^*3*1*:) who 

£T<D7*P -y ^ItWSflS A*Wt04-90Jfi 
Jf-f &7"P -y COyil-TlZftlXmVMZtl 

[ 0 0 5 4 ] 7 4 ;W^gt^9516TfflSS<lfcN x N7 

ft 6*1.6 (N+1)x(N+1)ct)7p -y ? r £ff *t£^< iW£ 
[»4] 



[0 0 5 6] i;-c. 

Xi,i=1,. 



X5-lt>tl& : 



mi] 

ii, xj trMXfvf (column stack) "s^ WHtig"? 

y(q-m,p-n), rfp-N<nspand 
Y 1 [n(N + 1)+m,pN+qI = q-N<msq 



0, 

fsWi,\=2^mf&nm<r)y*~'?'vyx'hh, nw iiss] 

y(q-m,p*N-n), ifp<nsp + Nand 
Y 2 [n(N+1)+m,pN+q] = q-N<msq 



[00 57] ftWs MttX^-t hflh : [»9 ] 

y(q + N-m,p-n), ifp-N<nspand 
Y 3 [n(N + 1)+m,pN+q] = q<msq+N * 5 

0, otherwise. 

[00 58] fiftfc. mi^m^X^-lhtlh : HSl 0 ] 

y(q+N-m,p + N-n), ifp<nsp + Nand 
Y 4 [n(N + 1) + m.pN*q] = ■ q«=m S q + N S6 

0, otherwise. 

[0059] mM. vnvxjymixrfimt-t £X^x*ktLimmra&£*~>xm>istib ■ 
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X/ & X^+GXj'+XjV+O. 
X b c & X 1 C -<()X2 C + X 3 C ({} -tJiX/cfi 
X c c & X 1 C + (|)X 2 C -X 3 C (D-<DX 4 C <J>, 



X d c & X 1 C -<|)X 2 C -X3 C <J)+(|>X 4 C <J> 1 



5*11 



crMi*>fn-e(Tia^fc±s)«aM)CT, x A 

« , i =1 , . ■ , 4li* * 7'n .y ? Xi co ? -f T2-e (TIES* t «t 
4 ) WDCT«, Yi , i 6 {a. b, c , d} fi (N+l) 2 xN 2 gtff 3*J (T 

(diagonal modulation matrix) T\ diag{(-l)p}, 
P =0 IH**$\ l-3(?)ffMfc»LT®<?)SJ&{t» 

[0060] DCF3ElW>jaW»t. ±IB1»I?> 
[006 1 ] l.^n^x;, i=l,..,4ii^-f77-e«2 

N-1 N-l f TTP 

X c (P,q) a EEy(n.m) cm — 



[SI 3] 



-D DCTJCioTSaHSit*. 

2.S«$tLfc7*n-/^li. 2-DA*7 5>f (5^8 

a4"tfT?iJXi c , i=2,3,4«\ *tl^«OH&tN'/X 
(iff Tn^m-f h Z. t fc5?a*. 

[ 0 0 6 2 ] 7"n -y ? xfcWt & ? 7°2-e«0HIIDCT , X« £ 
OSp,qSN-lfc*fLT : 

[112] 



cr 1 {Y c }(n,m) 4 EL 



c(p)c(q) Y 

Ny/2 



c(0)=c(N)=l/2&tfc(k)=l N-L lliSl 

COftK, ^-f7°l-eC0SDCT(i(N+l) x (N+l)<D7'n >y ? 

r- MP 1 fc*T LT)iffl3*lfc t%9A 71-eOifi2D D 
CT^SIff-tl.(N+l)x(N+l)ffiDCTff?ijC I -i SrCr 1 ■ X<*=x 



C„-x = X c . *13 

[ 0 0 6 4 ] 7'n -y 7 Y= tcHtS 9 A 7°l-e<0®DCT£ i 

[$14] 
DcosflHllcosfi^l *14 



[0065] flfRJOYi , i e {a, b, c , d} (i&O^Tlta^' 
[*15] 
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Y a = lc, |c 1 C l ," 1 +Y J C„" , (l»(|i)+Y,C|i 1 («|)«l)*Y 4 C l f , ((|)«(|>)|, Sl5 

Y b = lc, ^C,;' + Y 2 C„' 1 (l«<|>) -Y 3 C^ 1 (<M) -Y 4 C,, 1 (<M>)}, S16 

Y c = lc, {c,C,- 1 -Y 2 C„- 1 (I®*) + Y 3 C,- 1 (cM) -Y.C," 1 fl)®*)}, =£17 

Y d = lc, (/ 1 C„ 1 -Y 2 C l r 1 (l®4))-Y,C | - 1 (<|)®l) + Y < C l - 1 (<|)« ( )))}, SC18 



ZZX\ ftfcxlflti*n*.yJ&-8£*U UiN x Nfgi 
[00 66] vn&TMim. ( ; iTttwStiTv^Srv^ 

C0raRfctT-¥i.feil&«lTjlJYi.i6{a.b,c.d}* 

#B h ii h I v » o Utt #?# ii S . *»tt fc v ^ « u , 
o/X(4, SK6ri*]-tWfirC**ifcfcBWi"ft. 

\mm^-nmmm.mhz\b mixa< . r- 

* tffe f* S t V i -5 £ t 14, A7Jfflf«?>DCT7n -y 

mx-hi^tmixa<, stc, iW^-tfn* 

ftli, ffl* , DCT7"o >y ?«£±MRfc#tt1-*£ fc * 
fBLT*K. fcT, TO'J<0t5X<D~-gP, 
if A?j7'n v ?«£±#>PIHc#£^l>DCT^£jf 

[0067] Wfc LT&^3lM#i£^ 

tr. 

[0068] i . a*b«(22) mmvyhh?-? ? b 
s^HBa^-fs^-rft-s-r, ±iBA7jM8£gftt-i> 

Xf7 (112) , _hiE7JjM»fc , _LiEIS'&0*S 9 

- * fc Wffl M £ jjrffifcr - ? £ ^ TV Xt 
■y7k , ±IBfflWWfi^t^IA£m"t§ i fcfc 
=fc l»»M^«ii»iJ(116) * JJEW'&o* 

««HS#(26,32&tf36) ^S^Xt -y7t (48) , 
A^WI^ffiMJmS. 

[ 0 0 6 9 ] 2. ±EliE»«0*8cfci3VvC, JJBfl* 
«8(26, 32&V36) ^Mt^Xf -y7(48)#, Sgt. 



20) £ fc fc J: oT±ffi'l»«ffl«S:S!S'Jt^XT -/ 

bMf^-y£#«5p£«a6££tf>fc, ± 
IB7" P I T ? *>5g» fcfifc** £81 

ML^^±|B«fl«ffl««£R*1-^ i fc 
85. 

[ 0 0 7 0 ] 3. ±IB2lB»W*ffifc:*5^T, _tiBi8£W 
JS^SW^JSto^T: n v h 5 x b ft t . ± 

k LTO^I. 3 y h Mlflk ^itlW* xf- >y7°(l 

[ 0 0 7 1 ] 4. JJE1, 2X{i3tlB*K«^T*-7T , 
l/-- T±!Bi^ flHStStufeMS-f-^ 

[ 0 0 7 2 ] 5. ±fB4fBtt<0^tfcV^s ±IB^f«iM 
JUSWtf-^ttW'ti^r'yrdOO, 102, 104, 10 
6^108) *\ ±IE b V ^\%&Ztitz 

IWK ^wi««s/a«^& vx Xr 

•y 7(106) Sr^-tf^rjfe. 

[ 0 0 7 3 ] 6. JJBK 2, 3, 4Xi±5lB»«*ffitfc^ 
Ts JJERWWtaK-t^Xf- -y7(48)*s, ±E»fc 

fit JtlW-S Xf - -y 7 (118) Sr#tf>Vffi. 
[ 0 0 7 4 ] 7. A^H«(22)<0*ti'— y-y bHift^° 

^-y£«ffi-r h mmm -a do) -c* o t . ±ib 

BWi'OfcS ^-^-y bMf^^-ySrfr^S^W^ 
taBMW^-vkwBWtfc 0(114), JilBHffeffl 

«&atK-ri=m i «as?^s(56) fc , m% 1 «as?# 

«8tC^tJlR«ha«(26, 32&W36) SS^-t&fcWKi 

mMBW*ai8'j^ & m 2 (66) x\ mm 
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[ o o 7 5 1 8. mjim^yxfuza^x. 

[00 7619. ±IB7X{i8tfe»c7)^Xri,T"J)o 

zmtitzMzmm i oss?¥S(56) tmmbxm 

m¥&£ttfo+& h V-->-/Bfl^#£OJl$iMfr 
£B^-tS£tf>?)VX#-(78) S^tf^^rA. 
[ 0 0 7 7 ] 10. ±|B7, ^Ximim^yXr-UZh^ 

x , ±ieib 2 «iifK^a (66) a , ±t am i (5 

6)i:lty!IfcJJaiS*lWf«»7-f/l'^(66)t*», 

felt* LTftfefifca V h 9 x MISraBS 3 > h 5 7 h 
BMI t Jt« ( 122) -fhZ.t\Z^X ±ia«fflffl Ji (26 , 32 

[00 78] 

[02] Illcoli^ai>-A7 : -i>,^tlt»-?^'fe^^T'- 



[04] 03«MSfOtJ;oT|il^^til>8 x 8B« 
[05] 01t^5tl^mti}^«rtgii«^^t-7"n 7 
[06] Hlfc*5*lfc7^/^lS4*IB«l*3SBfltBR*S 

-ryn-/^0 o 

[07] mw? vv?m^m&fc£-oxfthtih~?x7 
[08] ^ ivmmm-mmxn 

[09] Slfftfflfc|gLT\ A*B«^+T"«WtlS5: 

10 H^ttJ^XrA 
12 MffijMiO 

14 mmtau 

16 7 ;l/^$£j3!clffi 
52 

56 mm&7 4)v* 

58,60,62 3^h5XMHtSI5 

64 a3et^a-;i/ 

66 #£f*7 A )V9 

72 *-yb7-? 

74 W^--vb 

76 Dcra5(«ifc3^ySSlffl5) 

78 -?7#- 

80 IDCTgP (««!3^y^gP) 



[01] 
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[02 ] 



IligilllgKlligiSIJ 




[04] 



[05] 
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7* ;i/*tt*Ettt* 
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